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INTRODUCTION 


The  objective  of  this  study  is  to  investigate  the  possible  use  of  pattern  recognition  techniques 
for  automatic  target  designation  in  television-guided  weapons.  Pattern  recognition  is  a  broad  field 
covering  many  areas  only  one  of  which  is  optical  pattern  recognition.  One  attractive  method  from 
this  broad  field  was  selected  for  study. 

The  method  used  in  the  study  was  computer  simulation.  Target  signatures  were  either  drawings 
digitized  by  hand  or  videotaped  images  of  models  digitized  by  machine. 

Pattern  recognition  is  usually  thought  of  in  terms  of  two  steps.  The  first,  feature  extraction,  is 
the  process  of  making  some  kind  of  measurement  resulting  in  definite  parameters  to  be  used  in  the 
second  step.  The  second  step  is  classification.  Here  a  person  designing  a  pattern  recognition  system 
must  choose  how  decisions  based  upon  the  selected  features  are  to  be  made  and  how  many  classes 
can  be  established  for  dividing  up  the  patterns  received. 

The  basic  framework  of  the  problem  treated  here  is  shown  in  Figure  1 .  It  is  assumed  that  a 
practical  target-recognizing  weapon  would  take  the  form  of  a  CCD*  television  sensor  and  some  kind 
of  microprocessor,  probably  one  with  microprogrammed  instructions.  Television  sensors  of  any 
kind  are  notorious  for  producing  wide-band  output.  Pattern  recognition  algorithms  must  be  very 
carefully  configured  in  order  to  avoid  having  the  processing  system  swamped  by  the  high  data  rate 
emanating  from  the  camera. 

When  a  person  undertakes  to  recognize  a  visual  pattern,  he  tends  to  overlook  some  very  im¬ 
portant  subtleties  that  are  automatic  in  human  perception.  If  one  perceives  a  pattern,  such  as  a 
rectangular  window,  it  is  generally  not  from  a  similar  rectangle  projected  on  the  retina.  The  posi¬ 
tion  of  a  person’s  head  (perhaps  titled),  the  orientation  of  the  window  (perhaps  oblique),  and  the 
distance  from  the  eye  all  combine  to  transform  the  perceived  pattern  into  something  other  than  the 
original  when  projected  onto  the  retina.  A  person  does  not  notice  these  transformations,  however. 


Figure  1.  Pattern  Recognition  Applied  to  Automatic  Target  Designation 


*Charge-coupled  device. 


1 


Our  perceptive  processing,  whatever  form  it  may  have,  is  invariant  with  respect  to  these  transforma¬ 
tions.  If  a  machine  is  to  perform  optical  pattern  recognition,  it  too  must  be  configured  to  be  invari¬ 
ant  to  such  transformations  as  the  optical  situation  may  impose. 

Fortunately,  methods  for  deriving  mathematical  transformations  having  properties  similar  to 
those  found  in  human  perception  have  been  published  by  Hu.1*3  These  transformations,  called 
moment  invariants,  will  be  used  in  this  investigation.  One  transformation  that  can  be  incorpo¬ 
rated  into  the  invariances  is  that  of  vehicle  roll,  inviting  the  possibility  of  a  weapon  that  does  not 
need  an  elaborate  roll -control  subsystem. 

Another  problem  area  to  be  addressed  is  that  of  treating  an  optical  scene  that  contains  many 
objects,  each  of  which  must  be  evaluated  as  a  potential  target.  It  is  desirable  that  the  separation  of 
the  objects  be  done  during  a  raster  scan  of  the  scene  rather  than  by  a  process  requiring  random 
access  to  the  picture  elements  (pixels)  of  the  scene  under  evaluation.  While  random-access  television 
sensors  exist,  their  state  of  development  and  economy  lag  those  using  conventional  TV  raster  scans. 
Raster-scanning  feature-extraction  algorithms  are  rare  in  the  literature.  Work  in  the  area  has  been 
undertaken  by  Scott  and  Preston3  and  by  Agrawala  and  Kulkami.4  A  feature-extraction  algorithm 
inspired  by  but  differing  from  their  publications  has  been  designed  and  used  in  this  study. 


MOVEMENT  INVARIANT  THEORY 

The  idea  of  using  moment  vectors  transformed  by  invariant  operators  as  features  for  pattern 
recognition  was  first  suggested  by  Hu.1  In  this  method,  the  features  extracted  from  a  pattern  to  be 
classified  are  moments.  Usually  the  patterns  are  in  the  form  of  silhouettes.  A  set  of  moments  {mpq} 
are  required  and,  while  these  are  defined  by  the  Riemann  integral 

+  oo  +oo 

mpq  =  r  f  xvyqp(x,y)dxdy  (1) 

J-.0O  *^-oo 

(where  x,y  -  cartesian  coordinates,  and  p(x,y)  =  pattern  density  function),  the  quantized  digital 
nature  of  the  pattern  coordinates  and  the  binary  nature  of  the  density  of  a  silhouette  mean  that  the 
moments  (mpq}are  really  computed  by 


"»pq  =  £  <2) 

/■i 

(where  =  coordinates  of  ith  pixel  in  pattern,  N  -  number  of  connected  pixels  in  the  pattern). 

Summation  (2)  represents  the  major  compromise  taken  to  reduce  the  bandwidth  of  the  tele¬ 
vision  signal.  Figure  2  shows  a  potential  target  that  is  first  quantized  in  space  by  the  camera’s  pixel 
grid  and  then  quantized  into  a  silhouette  through  selection  of  a  gray  level  for  which  a  darker  shade 
is  made  black  and  a  lighter  shade  is  made  white.  The  pattern  that  enters  the  pattern  recognition 
process  is  really  a  rectangular  grid  with  each  site  containing  a  Dirac  delta  of  value  0  or  1 .  Thus  is 
made  the  transition  from  Equation  (1)  to  (2)  with  all  the  errors,  noise,  and  ambiguity  such  process 
ing  implies. 
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Figure  2.  Spatial  and  Gray  Level  Quantization  of  a  Target  Image 
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Hu2  describes  the  transform  to  change  the  set  {mM  }  of  ordinary  moments  into  the  feature 
vector  {A/i}  containing  moment  invariants  as  an  a  fine  transform  that  can  be  decomposed  into  a 
sequence  of  elementary  transformations.  The  user  of  Huts  work  may  select  those  elementary  trans¬ 
formations  that  suit  his  purpose  and  concatenate  them  at  will  within  certain  restrictions.  Elemen¬ 
tary  transformations  from  which  one  may  choose  include  those  listed  below.  The  result  of  each 
transformation  except  the  last  is  called  a  “canonical  moment,”  meaning  that  the  results  are  moment 
invariants  (functions  of  moments  that  are  invariant  to  some  parameter  such  as  size)  that  are  them¬ 
selves  moments.  Canonical  moments  can  be  subjected  to  still  another  transformation  if  needed. 
Elementary  transformations  derived  in  general  form  by  Hu  include: 


1. 

2. 

3. 

4. 

5. 

6. 


Position*  (change  ordinary  moments  {mM }  to  central  moments  (jipq  \ 
Horizontal  shear*! 


>  (Nullify  the  effects  of  perspective) 


Vertical  shear*  j 

Anisotropic  amplification*  (Nullify  the  effect  of  an  oblique  view) 
Size*  (Become  invariant  to  distance  to  object) 

Rotation  (Allow  observer  to  rotate  around  the  optic  axis) 


Additionally,  the  user  may  select  the  order  of  the  moments  (p  +  q  =  order)  and  the  size  of  the 
set  { mpq  }  that  are  to  be  employed  for  feature  extraction.  The  theory  is  written  in  terms  that  are 
quite  general;  however,  it  appears  that  a  practical  computational  limit  may  exist  with  the  orders 
(p  +  q)  reaching  three,  resulting  in  a  set  { Afj>  of  seven  elements. 

The  next  section  treats  the  method  used  to  “parse”  the  picture  into  its  several  patterns  to  be 
classified.  Thereafter  we  will  return  to  the  exact  order  and  size  moment  invariant  set  that  was  de¬ 
rived  and  evaluated  experimentally. 
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THE  SHORT-LIST  ALGORITHM 

The  short-list  algorithm  is  a  process  designed  to  extract  from  raw  video  data  the  necessary  sets 
of  moments  (mpq }  for  each  recognizable  pattern  within  the  field  of  view.  The  main  requirement  for 
such  an  algorithm  is  that  it  be  as  simple  as  possible  in  order  to  be  able  to  process  a  frame  of  video 
data  in  the  shortest  possible  period  of  time.  In  a  weapon,  this  algorithm  would  probably  be  in¬ 
corporated  into  a  single  microprogrammed  microprocessor  instruction. 

The  video  data,  as  it  reaches  the  short-list  algorithm,  is  assumed  to  have  been  sliced  at  some 
appropriate  gray  level  so  as  to  contain  a  background  of  “0”  pixels  with  “1”  pixels  forming  patterns. 
Figure  3  is  a  computer  printout  that  illustrates  what  a  portion  of  such  a  frame  might  look  Idee.  The 
background  pixels  are  blank  and  the  “1”  pixels  are  shown  as  asterisks.  Connected  groups  of  “1" 
pixels  are  considered  to  comprise  patterns  to  be  processed  for  recognition.  Pixels  are  considered 
connected  if  they  join  similar  pixels  above,  below,  or  to  either  side.  Figure  4a  contains  five  pixels 
that  are  connected,  and  Figure  4b  contains  five  pixels  that  are  not. 


'Canonical. 
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Figure  3.  Edit  of  a  Typical  Binary  Image 


5 


Figure  4.  Connected  and  Unconnected  Pixels 


The  algorithm  receives  a  train  of  1  or  0  pixels  in  sequence  as  the  raster  scan  proceeds.  It  has 
been  found  that  a  zig-zag  scan  such  as  that  shown  in  Figure  5  is  best  for  this  purpose.  The  algorithm 
maintains  a  table  that  at  the  end  of  the  scan  will  contain  sets  of  moments  for  each  pattern  found. 
Each  row  or  entry  of  the  table  contains  three  control  quantities  U,  R,  and  L  plus  the  required  num¬ 
ber  of  moments  {mpq }.  Initially,  the  contents  of  the  table  are  all  set  to  zero.  As  pixels  arrive,  each 
“  1  ”  pixel  is  assigned  an  entry  in  the  table  and  the  moment  values  { mpq }  are  incremented  with  the 
appropriate  quantity  according  to  Equation  (2).  The  algorithm  strives  to  assign  connected  pixels 
to  the  same  entry  of  the  table  and  to  consolidate  entries  that  are  found  to  be  parts  of  a  common 
pattern. 

For  purposes  of  checkout  and  early  conceptual  design,  the  algorithm  has  been  programmed  in 
Fortran  and  provided  with  printouts  that  monitor  its  operation.  As  the  image  is  scanned  and  “1” 
pixels  appear,  each  “1”  pixel  is  assigned  an  entry  in  the  moment  table  and  the  summations  per¬ 
formed.  Each  entry  in  the  table  is  assigned  a  character  as  address  identification,  and  a  printout  of 
the  binary  image  inserts  the  assigned  character  into  the  corresponding  place  in  the  image. 


Figure  5.  Zig-Zag  Raster  Scan  Used  in  the 
Short-List  Algorithm 


Character  assignments  are  made  with  knowledge  of  only  two  pieces  of  information:  (' )  the 
character  assigned  to  the  previous  pixel  scanned  and  (2)  the  character  assigned  to  the  pixel  just 
above  the  current  one.  When  a  “0”  pixel  is  received,  no  summation  takes  place  and  the  printout 
always  shows  a  blank  character  assignment.  When  a  “1”  pixel  is  received,  the  following  rules  prevail. 

1 .  If  the  previous  character  P  and  the  above  character  A  are  both  blank,  assign  a  new  char¬ 
acter.  To  assign  a  new  character,  search  the  moment  table  for  the  lowest  entry  not  in  use  by  seeking 
an  entry  with  the  U  code  equal  to  0.  In  making  the  character  assignment,  set  U  =  1  and  do  the 
summations. 

2.  If  either  A  or  P  are  nonblank  and  the  other  is  blank,  assign  the  nonblank  character  and  do 
the  summations. 

3.  If  A  and  P  are  nonblank  and  equal  to  each  other,  assign  that  equal  character  and  do  the 
summations. 

4.  If  A  and  P  are  both  nonblank  but  not  equal  to  each  other,  assign  the  smaller  of  the  two 
and  do  the  summations.  Also,  increase  the  U  code  in  the  assigned  entry  by  1  and  enter  that  assigned 
character  into  the  R  or  reference  column  of  the  greater  of  P  or  A. 

Figure  6  shows  a  sample  image  that  contains  two  patterns  of  connected  “1”  pixels  and  an 
isolated  “  1  ”  pixel.  Also  shown  is  the  moment  table  resulting  from  a  scan  and  the  above  rules.  Only 
mpq  with  ( p,q )  =  (0,0)  is  shown  among  the  moments.  This  0th  moment  is  equal  to  the  total  num¬ 
ber  of  pixels  assigned  that  character.  If  one  now  scans  the  entries  from  the  higher  characters  to  the 
lower  and,  upon  finding  an  entry  with  reference  R  ¥=  0,  merges  the  moments  of  that  entry  with 
those  of  the  entry  referenced  and  further  clears  that  entry  with  that  reference  to  all  zeros,  then  the 
result  will  be  a  table  containing  one  active  entry  (U  =*=  0)  for  each  pattern  in  the  image. 

The  algorithm  as  just  described  does  deliver  a  table  containing  the  necessary  moments  {mpq} 
for  pattern  recognition  and  target  designation.  It  is  not  economical  with  memory  space,  however. 
Isolated  “1”  pixels  like  entry  8  and  once-used  entries  like  2,  5,  and  7  remain  active  through  the 
process  using  up  valuable  moment  table  space.  To  make  better  use  of  memory  resources,  a  process 
called  purging  was  introduced.  It  also  turns  out  that  purging  introduces  the  possibility  of  a  mal¬ 
function.  It  has  been  found  that  images  that  contain,  among  many  other  patterns,  objects  that  are 
long,  twisted,  and  narrow  may  be  incorrectly  processed  in  that  the  long  patterns  are  occasionally 
cleaved  at  narrow,  one-character-wide  points.  Malfunctions  have  not  been  observed  within  the 
more  compact  patterns  that  are  likely  to  be  identifiable  targets,  however,  and  the  purging  process 
has  been  kept. 

Purging  is  a  process  that  is  invoked  periodically  during  a  raster  scan.  The  period  that  has  been 
used  in  the  Fortran  simulation  is  one  per  scan  line.  Longer  periods  may  be  optimal,  but  no  exact 
determination  has  been  made.  The  object  of  the  purge  is  to  remove  from  the  table  those  entries 
that  are  not  in  current  use  (i.e.,  not  used  since  the  last  purge)  and  either  represent  objects  too 
small  to  be  considered  for  recognition  processing  or  entries  that  can  be  combined  with  other  larger 
entries.  Entries  that  are  not  in  current  use  are  identified  by  means  of  the  flag  L  in  the  moment 
table.  Each  time  an  entry  is  used  for  a  moment  summation,  that  flag  is  set  to  1 .  As  each  active 
entry  is  addressed  during  a  purge,  L  is  set  to  0.  Thus,  when  an  active  entry  (U  #  0)  is  addressed 
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Figure  6.  Sample  Image  with  Character  Assignment  and 
Moment  Table  Entries 


that  has  L  =  0,  it  is  known  that  this  entry  has  not  been  used  since  the  previous  purge  and  may  be 
considered  for  elimination. 

The  printout  from  the  Fortran  simulation  identifies  those  entries  purged  at  the  end  of  each 
scan  line  by  printing  their  identifying  characters  in  a  row  to  the  right  of  the  image  frame.  The 
progress  of  the  dynamic  allocation  of  memory  space  can  thus  be  observed. 

The  logic  of  the  purge  and  merge  process  is  as  follows: 

1 .  Address  each  entry  in  the  moment  table  in  descending  order. 

2.  If  U  #  1 ,  ignore  entry.  If  U  =  0,  the  entry  is  not  active;  if  U  >  1 ,  then  it  is  referenced  by 
other  entries  and  must  be  kept. 
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3.  If  U  =  1  and  L  =  1 ,  set  L  =  0  and  go  on  to  the  next  entry. 


4.  If  U  =  1  and  L  =  0  and  R^O,  combine  the  moments  of  this  entry  with  those  in  the  refer¬ 
enced  entry  and  set  all  the  contents  of  this  entry  to  zero  (purge). 

5.  If  U  =  1  and  L  =  0  and  R  =  0  and  m00  <  S,  set  all  the  contents  of  this  entry  to  zero.  S  is 
that  number  of  pixels  needed  for  significant  size  in  the  recognition  process. 

6.  If  U  =  1 ,  and  L  =  0,  and  R  =  0,  and  m00  >  S,  go  on  to  next  entry. 

Figure  7  shows  the  printout  from  a  Fortran  simulation  using  the  above  rules  on  the  data  shown 
in  Figure  3.  The  useful  result  is,  of  course,  the  contents  of  the  moment  table  at  the  end  of  the  scan. 
That  table  appears  in  Figure  8.  It  can  be  seen  that  the  copious  amount  of  information  from  the  tele¬ 
vision  sensor  has  been  reduced  to  a  table  of  numbers,  the  data  format  in  which  the  microprocessor 
performs  best.  The  short-list  algorithm  is  thus  a  preprocessing  step  used  in  order  that  the  final  selec¬ 
tion  process  can  function  without  being  swamped  with  details.  Similar  preprocessing  is  really  em¬ 
ployed  by  people  in  most  decisionmaking  situations.  For  this  reason,  the  short-list 
algorithm  was  named  after  the  title  of  Chapter  5  in  the  famous  work  on  decisionmaking  by 
C.  Northcote  Parkinson.5 


N-ORDER  MOMENT  HARDWARE 

If  a  process  like  the  short-list  algorithm  is  to  be  implemented  in  conjunction  with  an  image 
sensor,  then  some  consideration  of  special  hardware  becomes  necessary.  A  very  slow  imaging  de¬ 
vice  such  as  a  millimeter  wave  sensor  would  issue  video  data  at  a  slow  enough  rate  to  permit  the 
algorithm  to  be  implemented  with  ordinary  programming  techniques.  A  CCD  sensor  mounted 
aboard  a  missile  would  be  in  a  different  situation,  however.  A  possible  implementation  might  em¬ 
ploy  a  bit  slice  microprocessor  with  microprogrammed  instructions.  If  a  256  X  256  sensor  is  used, 
then  values  of  *p  ,  yi  for  0  <  x  <  255,  0  <  >■  <  255  would  be  repeatedly  needed.  While  y*  need  be 
recomputed  only  for  each  row,  xP  values  repeat  over  and  over  again.  Recomputation  of  x?  values 
might  well  be  avoided  by  using  a  hardware  multiplier  or  a  read-only  memory.  Obviously,  quantities 
like  (255)3  require  rather  large  word  sizes  (24  bits)  and  tit*,  associated  hardware  has  corresponding 
expense.  Also,  third-order  moments  imply  a  set  (mpq  }  of  10  elements,  four  of  which  must  accept 
24-bit  increments.  On  the  other  hand,  very  fine  discrimination  among  various  types  of  aircraft 
using  third-order  moments  have  been  reported.2  6 


SECOND-ORDER  EXPERIMENTS 

Since  the  implementation  of  third-order  moment  computation  involves  a  significant  increase 
in  system  complexity  over  what  would  be  required  for  only  second-order  moments,  a  second-order 
moment  invariant  set  was  implemented  and  experimented  with  as  a  preliminary  step. 

Starting  with  an  ordinary  moment  array  from  the  short-list  algorithm,  the  following  invariants 
were  computed  in  the  Fortran  simulation  program. 
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Figure  7.  Image  Printout  from  the  Short-List  Algorithm 
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Figure  8.  Moment  Table  from  the  Short-List  Algorithm 


Given  {  mN }  =  m00 ,  mo  1  >  "*02  > m  1  o  > m  n  > m  20  >  convert  the  second-order  ordinary  moments  to 
central  moments  ppq .  By  definition, 


oo 

(x  -  x)p  (y  -  y)qf(x,  y)  dx  dy  (3) 

oo 

(where  x  =  x  centroid  =  m10/m00,  and  y  -y  centroid  =  m01/m00). 


By  integrating  Equation  (3)  by  parts,  it  can  be  shown  that 


/*02  ~  mo2  y 2 


mu  =  »»ii  -  *y 


(4) 


M20  “  m20  “  x1 


These  results  are  moment  invariants  (invariant  with  respect  to  position)  which  are  moments 
themselves  (canonical  moments),  so  we  are  justified  in  applying  a  second  transformation  to  them. 
This  second  transformation  is  one  of  size  invariance,  and  for  general  (p,q)  it  takes  the  form 


Mpq 


pq 


F?«) 

moo 


p  +  q  >  2. 


For  our  second-order  moment  invariant  set 
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Finally,  we  desire  rotation  invariance.  This  final  transformation  is  not  canonical  because  the 
products  of  the  process  are  not  moments  but  merely  functions  of  moments.  We  must  be  content  to 
have  this  be  the  final  transformation.  For  second-order,  there  are  only  two  moment  invariants.  They 
are 


Mi  =  1*20  ♦  M02 

=  0*20  -**02)2  +  • 


A  proof  of  the  validity  of  these  final  invariances  appears  in  Appendix  A. 

The  two  variables  ,  Af2)  will  now  be  used  as  features  extracted  from  patterns  in  the  original 
picture  and  made  invariant  to  three  effects  of  the  variable  viewpoint  from  which  they  might  have 
been  observed. 

Various  patterns  were  generated  by  hand  and  submitted  to  a  Fortran  program  which  entailed 
(1 )  a  punch  card  input  format  of  one  card  per  scan  line  of  64  binary  pixels,  (2)  the  short-list  algo¬ 
rithm,  and  (3)  Equations  (S),  (6),  (7).  Details  of  the  program  appear  in  Appendix  B. 

Each  pattern  generates  a  point  in  two-dimensional  {Mx ,  M2)  feature  space.  Experimental  steps 
were  undertaken  to  see  if  patterns  that  might  resemble  targets  tend  to  cluster  or  otherwise  distin¬ 
guish  themselves  in  feature  space. 

An  array  of  digital  approximations  to  various  geometric  shapes  was  prepared  and  fed  into  the 
program.  The  shapes  were  compact  solid  patterns  that  were  thought  to  be  representative  of  man¬ 
made  objects  likely  to  be  targets.  Some  of  these  patterns  together  with  their  resulting  point  in 

feature  space  appear  in  Figure  9.  Compact,  fairly  symmetrical  patterns  such  as  these  generate 
points  in  a  rather  restricted  area  of  feature  space,  and  the  loci  of  some  of  them  appear  in  Figure  10. 
The  obviously  symmetrical  patterns  like  the  circle,  the  square,  and  the  equilateral  triangle  all  lie  on 
the  Mx  axis,  since  M2  is  a  measure  of  elongation.  The  solid  circle  occupies  the  lowest  position  on 
the  A/]  axis  because  this  shape  has  the  smallest  possible  radius  of  gyration  for  a  given  area.  A  square 
has  a  greater  radius  of  gyration  for  a  given  area,  and  an  equilateral  triangle  has  a  still  greater  radius 
of  gyration.  Symmetric  hollow  patterns  can  lie  anywhere  on  the  Af]  axis  that  exceeds  the  position 
occupied  by  the  solid  circle. 

As  the  basic  symmetrical  patterns  are  elongated,  their  point  in  (Mx ,  M2)  feature  space  follows 
a  locus  upward  and  to  the  right.  The  three  loci  shown  in  Figure  10  resulted  from  elongating  the 
circle,  the  square,  and  the  equilateral  triangle.  The  rectangle  composed  of  a  7  by  12  matrix  of  pixels 
was  subjected  to  additional  distortions.  The  point  in  feature  space  generated  by  the  undistorted 
rectangle  is  the  solid  dot  beside  the  third  rectangle  from  the  bottom.  Quantized  approximations  of 
this  same  shape  in  two  different  rotated  positions  appear  in  Figure  9,  and  their  points  in  feature 
space  are  plotted  in  Figure  10  as  circles  and  connected  to  the  unrotated  point  by  dotted  lines.  The 
7  by  1 2  rectangle  was  also  skewed  into  a  rhomboid,  and  its  point  in  feature  space  is  plotted  as  a 
hollow  square  and  connected  to  the  original  by  a  dashed  line.  Applying  skew  has  a  similar  effect  in 
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CIRCLE  AND  ELLIPSES 


(0  169,0)  (0  162.0.000922)  (0  166.0  00217)  (0  198.0  0139)  (0194.0.0123) 


SQUARE  AND  RECTANGLES 


(0  165.0)  (0.172.0  002361  (0  189.0  00888)  (0  216.0.0195)  (0  277.0.04941 


RECTANGLE  -  ROTATED.  SKEWED  AND  ROUNDED 


10  189.0  00888)  (0  187.0  008361  (0  187.0  00750)  (0  202.0  0138)  (0  170.0.00342) 


ISOSCELES  TRIANGLES.  RIGHT  TRIANGLE 

A  A 

(0  222.0  0124)  (0  191.0  000024)  (0  193,0  000744)  (0  221.0  0122)  (0  278.004131 


Figure  9.  Geometric  Patterns  and  their  Second-Order  Feature  Space  Coordinates 


feature  space  as  elongation.  This  represents  an  important  extra  invariance  since  flat  objects  viewed 
from  an  oblique  angle  have  a  skewed  appearance.  A  similar  effect  is  noticed  in  triangles.  While  the 
equilateral  triangle  lies  on  the  M  i  axis,  other  triangles  occur  on  a  locus  emanating  from  that  point. 
As  a  result  of  the  “free”  skew  invariance,  isoceles  triangles  and  right  triangles  share  the  same  locus 
except  that  a  right  triangle  must  lie  above  that  point  occupied  by  a  45°  right  triangle. 

The  discrimination  power  of  second-order  moment  invariants  for  land  targets  was  considered. 
Figure  1 1  shows  some  sketches  of  what  a  tank  might  look  like  at  low  resolution  and  at  several 
orientations.  Also  included  in  the  sketch  are  a  few  shapes  that  might  show  up  in  a  scene  containing 
isolated  patches  of  dark  vegetation  such  as  trees  against  a  grass  background.  These  items  are  shown 
as  silhouettes  in  Figure  12,  which  also  shows  their  respective  points  in  feature  space.  The  loci  of 
ellipses,  rectangles,  and  triangles  in  feature  space  are  also  shown  for  reference.  While  the  tank  shapes 
generally  follow  the  rectangle  locus  and  two  of  the  trees  (B  and  C)  are  out  of  the  feature  space 
neighborhood  shown,  the  other  two  trees  are  within  the  region  that  is  occupied  by  tanks.  The 
hatched  region  between  the  ellipse  and  rectangle  loci  and  below  M2  -  0.01 8  is  considered  to  be 
“characteristic  of  tanks”  and  perhaps  also  characteristic  of  silhouettes  that  bear  some  resemblance 
to  those  of  tanks. 

As  an  additional  indication  of  the  kind  of  discrimination  that  might  be  expected  from  second- 
order  moment  invariants,  another  drawing  was  prepared  and  processed.  This  drawing,  which  appears 


Figure  10.  Moment  Invariant  Loci  for  Various  Solid  Geometric  Shapes 
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in  Figure  13a,  represents  a  possible  section  from  a  land  target  area.  It  includes  a  target  shape  (a 
tank)  and  an  array  of  other  items  such  as  barnyard  paraphenalia  and  shrubs.  This  drawing  was  hand- 
digitized  in  two  different  orientations  (Figures  13b  and  13c)  representing  two  roll  angles  of  the 
picture-taking  vehicle.  The  moment  invariants  Mx  and  M2  were  computed  for  each  of  the  patterns 
in  these  digitization  and  the  results  are  plotted  in  Figure  14.  The  digitization  noise  caused  some 
points  to  shift  in  the  two  orientations.  Points  representing  like  patterns  are  connected  by  a  dashed 
line  in  Figure  14.  It  can  be  seen  that  shapes  other  than  the  tank  have  intruded  into  the  area  in 
(Mx ,  M2)  space  characteristic  of  tanks.  Many  other  shapes  were  completely  eliminated  in  this 
discriminaticn  process  as  well.  Actually  there  is  a  third  feature  that  could  be  used  to  aid  in  the  dis¬ 
crimination  and  that  is  the  ordinary  moment  m00 .  The  Oth  moment  m00  is  the  pixel  count  for  the 
pattern,  and  if  altitude  is  known  at  the  picture-taking  time  (perhaps  from  barometric  pressure)  then 
patterns  having  an  area  inconsistent  with  the  anticipated  target  size  could  be  eliminated. 

The  final  target  scenario  considered  was  at  sea.  Clutter  there  is  much  less  in  evidence,  and  the 
problem  of  partly  occluded  targets  all  but  disappears.  Patterns,  if  they  are  a  target,  will  tend  to  have 


Figure  1 1 .  Some  Sketches  of  Possible  Land  Targets  and  Possible  Gutter 
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a  characteristic  boat  shape.  Other  objects,  such  as  small  islands,  shorelines,  rocks,  and  docks,  can  be 
expected  to  have  very  different  shapes  and  very  different  mappings  into  (M2 ,  M2  )  space. 

Psychological  testing  has  been  done  at  the  Naval  Surface  Weapons  Center  to  determine  the 
target-discrimination  capacity  of  a  man  viewing  a  sea  target  through  a  television  monitor.  One  such 
test  was  to  discriminate  between  two  models  shown  in  Figures  IS  and  16.  They  roughly  represent 
the  eastern  KOMAR-  and  OSA-type  ships,  respectively.  These  photos  were  digitized  by  hand  so  as 
to  have  four  different  sizes  of  target  image.  The  digitized  silhouettes  appear  in  Figure  17.  The  eight 
patterns  are  designated  KN  and  O^  s  1,  2,  3, 4,  and  the  numbers  of  pixels  in  each  are  tabulated 
below. 


N 

Kn 

On 

1 

364 

671 

2 

229 

417 

3 

54 

105 

4 

36 

67 

The  two  sets  of  points  representing  the  various  digitizations  in  (Af, ,  M2 )  space  appear  in  Fig¬ 
ure  18.  Clearly,  the  two  types  of  target  are  well  separated  when  viewed  at  the  particular  aspect  in 
the  original  photos. 

Finally,  equipment  became  available  for  a  test  using  an  electronically  digitized  television 
image.  Figure  1 9  is  a  block  diagram  of  the  setup.  A  model  sea  scene  was  made  with  a  piece  of  pho¬ 
tographic  backdrop  paper  as  water,  a  piece  of  shag  carpet  as  an  island,  and  three  small  ship  models. 
The  ship  models  available  were  of  YORKTOWN,  ENTERPRISE,  and  MISSOURI.  They  were  about 
IS  cm  in  length  and  shaped  so  as  to  rest  on  a  surface  at  waterline. 

The  lab  equipment  consisted  of  a  television  camera,  a  Quantex  digital-image  memory  processor 
model  DS-20,  and  a  Tektronix  minicomputer  model  40S 1 .  The  Quantex  device  is  capable  of  digitiz¬ 
ing  one  frame  of  video  and  storing  the  result  in  internal  memory  (6  bits  per  pixel).  The  Quantex 
memory  can,  in  tum,  be  interrogated  by  the  Tektronix  4051 .  Two  basic  language  programs,  listed  in 
Appendix  C,  were  used  to  extract  and  format  the  data.  Figure  20  is  an  example  of  the  program  out¬ 
put.  A  1 28  x  128  pixel  area,  chosen  by  the  user,  is  averaged  into  a  64  X  64  pixel  output  array, 
which  is  presented  as  a  10  gray  level  printer  plot. 

Figure  2 1  is  a  photograph  of  the  sea  model  taken  through  the  television  monitor.  The  elevation 
angle  of  the  optic  axis  was  about  45°.  Three  images  were  digitized.  Each  contained  all  three  ships 
and  the  island.  Each  picture  featured  a  different  orientation  of  the  ships  so  that  end-on  views, 
broadside  views,  and  various  other  angles  were  included. 
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(b)  Hand  Digitizations  in 
Different  Orientations 

Figure  13.  Barnyard  Scene 
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Figure  14.  Moment  Invariants  from  Barnyard  Picture 


Figure  IS.  KOMAR  Model 
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Figure  16.  OSA  Model 


Figure  21 .  TV  Image  of  Sea  Model 


The  resulting  printouts  from  the  program  were  transferred  to  punched  cards  for  the  simu¬ 
lation  program  used  earlier  for  drawings.  Any  light  level  represented  by  a  0  (-  overstruck  by  a  0) 
was  transcribed  as  a  1.  The  resulting  points  in  feature  space  appear  in  Figure  22.  The  nine  ship 
mappings  are  plotted  as  large  dots.  For  comparison,  the  feature  space  points  for  OSA  and  KOMAR 
are  also  plotted  as  small  dots.  The  island  beaches  were  seen  as  two  patterns  by  the  program.  The 
feature  space  mappings  for  these  patterns  are  plotted  as  triangles.  It  can  be  seen  that  the  boats  and 
ships  fall  within  a  narrow  corridor  in  feature  space  while  the  beaches  lie  well  outside  this  region. 


CONCLUSIONS 

The  results  from  these  tests  are  considered  encouraging.  A  microprocessor  can  easily  interpret 
the  position  of  a  feature  space  point  in  terms  of  target  likeness  and  determine  the  most  likely  target 
among  an  array  of  such  points.  Having  done  that,  the  microprocessor  has  enough  data  to  designate 
a  target  to  a  more  or  less  conventional  TV  guidance  system. 

The  approach  in  this  investigation  has  been  a  heuristic  one.  Formal  pattern-recognition  theory 
embraces  other  more  analytical  procedures,  and  their  application  to  the  recognition  of  naval  targets 
should  be  investigated.  For  example,  once  target  shape  probabilities  and  clutter  density  can  be 
quantitively  assessed,  there  exist  definite  procedures  for  optimizing  the  classification  criteria  in 
feature  space  and  for  optimizing  the  number  of  dimensions  of  that  space.  An  appreciable  payoff 
for  going  to  third-order  moments  may  exist. 
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APPENDIX  A.  PROOF  OF  MOMENT  INVARIANTS 


Show  that  the  functions 
iWj  =  (pjQ  +  ^02 


M2  =  0*20  ~M02)2  +  4Mu 


are  invariant  with  respect  to  notation. 

Let  the  primed  variables Mx  ,M2,  x\,y\  represent  a  pattern  made  up  of  N  pixels  (Xj,^) 
transformed  by 


t  ~ 

xi 

cos  0 

sin  0 

_y\_ 

-sin  0 

cos  0 

.  Ti  . 

Then 

«;  - 1  k  + 

1  =  1 

N  r 

=  Y  L^i  cos  e  +  >'i  sin  fl)2  +  (“*  Sin  0  +y{  cos  0)2J 

i  =  i 

N  \ 

-  2_]  [jff  cos2  0  +  2XjVj  sin  0  cos0  +  v2  sin2  0  j 

1  =  1 

+  x2  sin2  0  -  2Xj>'i  sin  0  cos  0  +  y2  cos2  ©]2  i 

N  r  12  ; 

=  Y  Lx>2  (sin2  0  +  cos2  +  yf  (sin2  0  +  cos2  0)J  j 

=  Y  I*2  +  yf] =  M\  ■  1 


Likewise 


APPENDIX  B.  FORTRAN  PROGRAM 


The  following  Fortran  program  simulates  a  video  signal  processor  incorporating  the  short 
list  algorithm  and  moment  invariant  computation.  It  accepts  pixel  data  on  cards.  Each  input 
image  consists  of  a  background  of  blanks  (or  zeros)  with  patterns  of  ones  to  be  transformed  and 
recognized.  The  images  are  64  pixels  in  width  and  may  have  any  length.  Pixels  are  punched  in 
columns  1  through  64  as  blanks  or  (l)s.  Column  65  is  punched  (1)  if  the  card  does  not  represent 
the  bottom  of  the  image.  A  card  representing  the  bottom  of  the  image  has  column  65  blank  or 
zero  and  causes  the  program  to  process  the  image  and  print  out  (1)  the  picture  in  blank  or  (*) 
format,  (2)  the  raw  moments  for  each  object  in  the  field  of  view,  and  (3)  the  moment  invariants. 
If  a  card  representing  the  bottom  of  an  image  has  a  1  punched  in  column  66,  the  program  expects 
another  irpage  to  follow  in  the  deck.  Otherwise  it  stops. 


oouuuuuu  ouou  UUOM  OUO  H  N  U  U  U  O  u  o  o 


PROGRAM  PARSE  (INPUT«OUTPUT) 


PROGRAM  TO  PARSE  BINARY  IMAGES  INTO  ISOLATEO 
SILHOUETTS  ANO  COMPUTE  THEIR  MOMENTS 


DIMENSION  KARO  (6*1,  IPL(64>,  IPR(64),  MENUS, 13).  FONT  US) 
DIMENSION  ISH0TU5) 

DIMENSION  FEAT (10) 

EQUIVALENCE  (FEAT (l ) ,FB9) , (FEAT (2 ) ,Fyl*YBAR) , (FEAT (3) ,F«2) , 
1(FEAT (4) «F03)« (FEAT (5) *F18,XBAR) , (FEAT (6) ,F11) • (FEAT 17) ,F12I 
2(FEAT(8),F20), (FEAT (9 > ,F21) , (FEAT (IB) , F3B) 

INTEGER  FONT 


REAO  FONT 

REAO  700,  (FONT(I) ,1*1,45) 

PRINT  HEADERS 

PRINT  701 
PRINT  702 
PRINT  703 
PRINT  704 
PRINT  705 

INITIALIZE  PICTURE  PROCESSING 
•  •• 

LINE=0 
OO  1  1=1,45 
DO  1  J=l, 13 
MEM(2,J»B 
OO  2  K=1 *  64 
IPL(K)*f 

REAO  ANO  PROCESS  ONE  LINE  OF  VIDEO 
•  •  • 

1  IP*0 

LINE=LINEtl 

REAO  706, ( KARO (K) «K*1 , 64) .NEXT, MORE 


OO  11  LR*1,64 
K*LR 

LOOO=LINE , ANO, 1 
IF  (LOOO.EO.O)  K*65-K 
IA=IPL (K) 

IPL(K)*0 
I PR (K)=1H 
MAR=0 

IF(KARO)tO.EQ.O)  GO  TO  11 
•  •• 

GIVEN  * 


ouuuuuu 


uoo  OUOH  o  o  o 


•w 


c 


IF(IA.EQ.a.ANO.IP.EQ. II 
IFUA.EQ.a.ANO.IP.NE.ai 
XFIIA.NE. •.ANO.XP.EQ.il 
IFIXA.EQ.  XPI 
XFIXA.LT. IP) 


60  TO  IS 
60  TO  iS 
60  TO  1* 
60  TO  IS 
60  TO  IS 


SET  P  INTO  AIREFI 


HEH(IA,2I*XP 
NEN(IP.l) •NEN(XP.l) +1 


ASSI6N  P  .  SET  LINE  FLA6 


•  •• 

S  MAR« IP 

MEH(NAR,3>*1 
60  TO  16 

SET  A  INTO  PIREFI 


NENdP.2) *IA 
HEM dA.l)xN€N(IA« 11+1 
C  f  O  ® 

C  ASSI6N  A  ,  SET  LINE  FLA6 

C  ... 

16  MAR-IA 

MEM (MAR. 3 >*l 
60  TO  16 
C  ®  @  ffl 

C  SELECT  NEN  CHARACTER 

C  ... 

12  XFIN0«1 

00  121  ICK-1,65 

IF(NEN(XFXN0,ll.EQ.a>60  TO  121 
IFINO-IFINO+1 

120  CONTINUE 
print  rar 

60  TO  61 

121  NARxXFINO 

HEH(NARtl|xi 

C  ... 

C  INTE6RATE 

c  •  •• 

16  XPLIK)*NAR 

IPRIKJ*FONTINAR> 

MEM(MAR.S) »1 
HEM(MAR«6I*MEM (MAR. 6) +1 
NEHJNAR,5)«NEH (MAR.5I +LINE 
NEN(MAR.6 1 "NEN (MAR. 61  +LXNE*«2 
MENINAR.7  » *NEN INAR.T) +LINE**3 
NEN (NAR, 0  > «NEN (MAR. 0>  +K 
NENINAR.9) *NEN (MAR. 9) +K*LXNE 
HEN(NAR,ia»«NEN(NAR.iai+K*LINE**2 
N£N(NAR.ll)*NEM(NAR.ll) +K**2 
NEN(NAR,itl«NEN<NAR.12> +K**2*LINE 
NEN(NAR.13)xNEN(NAR.13)+K«*3 
11  IP* NAR 


B-3 


115 


121 


125 


135 


135 


151 


145 


15# 


155 


16# 


165 


c  •  •  • 

c  @  ®  ® 

C  PURGE  EXTRANEOUS  ENTRIES 

C  9  •  • 

00  11«0  IS=1.45 
HOC  1SH0T  (IS ) =1H 
IS-1 

00  1#0  IFWD*1 j  45 
IR£V=46-IFND 

IF(HEH(XREV.3t.EQ.ll  GO  TO  102 
IF(NEXT.NE.O.ANO.NEH(IREV, lt.NE.lt  GO  TO  100 
IF (NEXT. EQ.O. ANO. HEN ( IREV ,11 • EQ.O 1  GO  TO  100 
IF(NEN(IREV.2I.NE,I>  GO  TO  103 
IF(HEN(XREV,4I.GE.16I  GO  TO  100 

104  IRIP*NEH(IR£V,2l 

I SHOT (IS) -FONT  I IRE VI 
XS«IS*1 

00  105  IMsl.13 

105  HEN (IREV. IMI*0 
GO  TO  100 

102  HEH(IREV.3t*0 
GO  TO  100 

103  XREFxHEH ( IREVt 2) 

00  107  IN*4.13 

10  7  NEN  ( IREF,  INI  *NEH  ( IREF, IN)  *NEH  ( IRE  V.  INI 

IF(HEN(IREF,1> .GT.ll  HEH t IREF, 1) - MEN (IREF.lt -1 
IFIHEN (IREF.lt  .LE. It  ISH0T(45I>1H» 

GO  TO  104 
100  CONTINUE 

C  ... 

C  FINISH  LINE  ,  PRINT  TRACE 
C  **  «  * 

PRINT  700. LINE.  (IPR(III ,IX*1* 64).  IISMOT  UIII  •  III«1*6S! 

C  *  » 

C  TEST  FOR  ENO  OF  OECK 

C  ... 

IF(NEXT.NE.O)  GO  TO  10 
60  PRINT  705 

C  ... 

C  PRINT  HEHORY  ,  CLEAR  DENSE  PRINT  NOOE 

C  ... 

PRINT  710 
PRINT  711 
00  70  LOC*l,45 

IF ( HEN (LOC.lt.NE.Ot PRINT  712.LOC.FONT (LOCI. (NEHILOC.INt ,IM>1.13I 
70  CONTINUE 

C  B  *  W 

C  PRINT  SECONO  PHASE  HEAOERS 

C  ... 

PRINT  720 
PRINT  721 
C  . .. 

C  LOOP  THRU  HENORV,  CONFUTE  FEATURE  VECTOR 

C  ... 

00  56  L*l,45 

IF  (NENIL.lt. EQ.OI  GO  TO  56 
IF  (NEH(L,4t.LT.16t  GO  TO  56 


170 


B-4 


irs 


180 


189 


191 


195 


203 


205 


210 


215 


220 


C  ®  8  ® 

C  CONVERT  SUNS  TO  OROINART  NONENTS 

C  •  •• 

00  55  IN* 1.10 
INN>IM*3 

55  FEAT (INI*N£N(L.1NMI 

C  •  •• 

C  CONFUTE  3-RD  ORDER  CENTRAL  NONENTS 

C  *  * 

F03*  F03-3.0»F02*(F017F08l*2.0*F00*(F0i/FO0l**3 
F38*  F30-3.0*F2|* (F1B/F00 1 »2.0*F00*  (F16/F00 I **3 
F12*  F12-F02*(F187F00l-2.O*Fli*(F#i/FOOI*2.8*Fl8*CFBl/FO8l**2 
F21*  F21“F20*IF|1/F00 1-2. 0*F11*CF10/F08T*2.8*F01*IF10/F00l**2 
C  ■»  <*  * 

C  CONFUTE  2-NO  OROER  CENTRAL  NONENTS 

C  •  •• 

Fil*Fll-FOO* (F10 /Fill • (F01/FOO I 
F82*F02-FOO*(FOt/F»81 **2 
F28*F20-FOO»(F1|/F1«I  **2 
C  ... 

C  PRINT 

C  •  •• 

PRINT  723 

PRINT  722 .L.FONT (LI . (FEAT (INI , IM*1, 10 I 
C  • .« 

C  NORNALIZE  H.R.T.  SIZE 

C  «  s  e 

XBAR*F10/F00 

VBARsFOl/FOO 

F0O2*FOO**2 

F052*F80**2.5 

F02-F02/F002 

F43»F03/F052 

F11-FU/F002 

F12-F12/F052 

F20«F20/F002 

F21*F21/F052 

F30*F30/F052 

PRINT  725.  ( FEAT ( INI .IN* 1,101 

C  •  •• 

C  CONFUTE  THREE  HONENT  INVARIENTS 
C  ... 

VAR1*F20»F02 

VAR2«  (F20-F02l**2*4.0*Fll**2 
VARS*  (F3O-3.0*F12J **2* (3«0*F2i-F03l**2 
VAR4*  (F30+F12I **2t (F 21tFI3l**2 
C  « 

PRINT  724, VAR  1, VAR2.V AR3. VAR® 

56  CONTINUE 
IFINORE.NE.OI  CO  TO  3 
STOP 

700  FORNAT  (4 5 All 

701  FORNAT  (1H1/1HTI 

702  FORNAT  (23H  PROGRAN  PARSEI 

703  FORNAT  (1N0.18X, 10 (1H1I .10 (1H2I ,10 (1H3I.10I1N4I ,10 (1H5I .5 (INCH 

704  FORNAT  (10X,6(10N1234567890I*4N1234I 

705  FORNAT  (9X.66(1H»II 


225 


FORMAT  (6611) 

FORMAT  (23HB  NO  MORE  MEMORY  SPACE) 
FORMAT  ( 19, 1H*,64A1,1H*, 2X,45A1) 


FORMAT  (1H1/1HS) 

FORMAT  (16H  MEMORY/ 

1  LOC  CM  U  REF  L  MOO 

2  H10  Mil  Ml 2 

FORMAT  <I4,2X,A1,3I3'4X*1BZ10) 
FORMAT (40H1  MOMENT  INVARIANT 
FORMAT (50  HO  LOC  CHARACTER 

1  FIS  Fll  Fll 

2  F30) 

FORMAT <14, 11X,A1,4X,1IF10.3> 
FORMAT (1H  ) 

FORMAT  (3X,  7HVAR1-6* ,4E14.5) 
FORMAT (20 H  SIZE  NORNALIZE 
END 


COMPUTATION 

FOO 

F12 


«10F10, 3) 


PHASE  ) 
F01 
F20 


60  H 

HO  3,  60H 

M30) 


FI  2  ,  60  H 
F21  ,  10H 


SYMBOLIC  REFERENCE  NAP  (R»l> 


ENTRY  POINTS 
6112  PARSE 


5157 

FEAT 

REAL 

ARRAY 

6502 

FONT 

INTEGER 

5057 

FOO 

REAL 

5051 

FOO  2 

REAL 

5160 

F01 

REAL 

5061 

F02 

REAL 

5162 

F53 

REAL 

5052 

F052 

REAL 

5163 

FI? 

REAL 

5066 

Fll 

REAL 

5065 

F12 

REAL 

5066 

F?0 

REAL 

5067 

F21 

REAL 

5070 

F30 

REAL 

5021 

I 

INTEGER 

50  32 

IA 

INTEGER 

5135 

ICK 

INTEGER 

5036 

IFIND 

INTEGER 

5037 

IFNO 

INTEGER 

5046 

II 

INTEGER 

5065 

III 

INTEGER 

5025 

IP 

INTEGER 

5171 

IPL 

INTEGER 

ARRAY 

5271 

IPR 

INTEGER 

5163 

IREF 

INTEGER 

5060 

I  REV 

INTEGER 

5161 

IRIP 

INTEGER 

5036 

IS 

INTEGER 

6*57 

ISHOT 

INTEGER 

ARRAY 

5142 

IN 

INTEGER 

5050 

INN 

INTEGER 

5023 

4 

INTEGER 

5126 

K 

INTEGER 

5071 

KARO 

INTEGER 

5067 

L 

INTEGER 

5022 

LINE 

INTEGER 

5066 

LOC 

INTEGER 

5031 

LOOO 

INTEGER 

5130 

LR 

INTEGER 

5033 

MAR 

INTEGER 

5371 

MEM 

integer 

ARRAY 

5027 

MORE 

INTEGER 

5026 

NEXT 

INTEGER 

5053 

VAR1 

REAL 

5154 

VAR2 

REAL 

5055 

VARS 

REAL 

5156 

WAR4 

REAL 

5063 

X8AR 

REAL 

5060 

Y8AR 

REAL 

ARRAY 


ARRAY 


ARRAY 


APPENDIX  C.  BASIC  LANGUAGE  PROGRAMS 


The  following  two  BASIC  language  programs  for  the  Tektronix  4051  were  written  by 
Richard  Ely.  The  first  determines  (interactively  with  the  user)  which  portion  of  the  image  is  to 
be  stored.  It  then  places  the  pixel  array  in  a  cartridge  file.  The  second  program  prints  out  the 
contents  of  the  file  as  a  reconstructed  printer  image  from  which  the  numerical  values  assigned  the 
pixels  are  evident. 


)* 

C-l 


-  ■+ 


INIT 
PAG 


DIM  A0<129)»A1<129) fB( 1024) f A2<22) fH<64> 


KMWMfta*] 


•  2030 


K-(*L i» Mil  l—T’-f-r'-i 


REM  • THIS  SECTION  INPUTS  THE  COORDINATES  OF  THE  DESIRED  IMAGE  ON 
REM  THE  TV  SCREEN.  IT  PUTS  A  CROSSHAIR  ON  THIS  POSITION  SO  YOU 


REM  CAN  SEE  IF  IT  IS  THE  RIGHT  LOCATION.' 

PRINT  'ENTER  THE  COORDINATES  OF  THE  CENTER  POINT.' 


PRINT  *r=7f  <16  TO  496 ) 

INPjJTY _ 


PRINT  *X=?»  <16  TO  496)' 
INPUT  X 


REM 

REM  'THE  CENTER  POINT  OF  THE  CROSSHAIRS  IS  NOT  ALLOWED  TO  GET 


Wile] TMijn' nBlIH ^  »1  »i ■  1  Mk 1 3 1 aigfjila 1 1 1 JJ W ■  |  ■  ■  1 1 a 


EM  X  AND  Y  ARE  CHANGED  IF  NECESSARY  TO  SATISFY  THIS  CONDITION.' 


"  2170  REM 

■■  2180  IF  Y=>16  THEN  2200 


•  2190  Y=16 

-  2200  IF  Y<=496  THEN  2220 


»  2210  Y=496 

THEN  2240 _  _  _  _ 


»  2230  X=16 

»  2240  IF  X<=496  THEN  2300 


”  2250  X=496 

*  2260  REM _ _ _ 

•'  2270  REM  'THE  STARTING  POINT  FOR  THE  CROSSHAIRS  IS  l6  LINES  ABdV£  THE 


’  2290 

*  2300 


*  2310 
■  2320 

-  2330 


REM 

N1=<Y-10)*512+<X-1) 


REM 

REM  '21  VERTICAL  LINES  ARE  READ  OUT  AND  WRITTEN  INTO  BY  THE  FOL- 
REM  LOWING' INSTRUCTIONS  TO  FORM  THE  VERTICAL  CROSSHAIR.' 

PPM 


FOR  1=1  TO  21 
N=N1 


GOSUB  5020 

K2=3*< 1-1 ) _ 

REM 

REM  'THE  FOLLOWING  TELLS  THE  QUANTEX  IT  IS  GOING  TO  OUTPUT  DATA 


REM  STARTING  AT  LOCATION  N<GfF»E»D»C>  AND  T 
REM  WORDS  SENT  OUT < 37 » 48 » 64. 80 » 96) . ' 


REM 

WBYTE  B36 J-l t Otlt A1 r 3Ar2tGtFiErDrCt3> 37 tA8r 64 r 80 t96i IS 


REM 

ANTEX  IS  FORMALLY  ADDRESSED  AS  A  TALKER.' 


REM 

WBYTE  8685 


REM 

REM  'THE  4051  RECEIVES  THE  DATA  IN  THE  'B*  ARRAY.' 


RBYTE  B<K2+ 1 ) » B<K2+2) r B<K2+3> f  B(K2+4) _ 


REM 

REM  'THE  QUANTEX  IS  UNTALKED  AND  THEN  ADDRESSED  AS  A  LISTENER.  IT 
"REM  RECEIVES  THE  DATA  0f252f  AND  07* 

_REM _ 

MBYTE  895  f  36 i -Tf  Of 1f57f34f2f0fFfEfDfCf15f6f252fOf-1 


NEXT  I 
REM 


REM  'THE  HORIZONTAL  BAR  IS  ADDED  TO  THE  CROSSHAIR  AFTER  READIN 
REM  OUT  THE  PICTURE  INFORMATION.' 


REM 

Nl«(Y-l)*512+Otl.O) 


C-2 


.  2650 
2660 

FOR  1=1  TO  3 

N=N1 

2670 

2680 

PTTiT^rfDffnWBtWnch  ii  fl  'iimRR  i/iini'n/i 

RRMNHH 

2690 

MBYTE  8681 

2710 

K2=63+21*<I-1> 

■7771 

2730 

B<K2+J)«A2<J) 

■4/M 

NEXT  J 

2750 

DIM  A2<21> 

2760. 

2770 

2780 

MBYTE  095, 361-1.0, 1.57.34 .2.G.F.E.D.C, 15. A2.-1 
N1=N1+512 

2790 

NEXT  I 

2800 

N=N1-1024 

2810 

GOSUB  5020 

2820 

A2=252 

2830 

MBYTE  095 i 361 -1 .0.1.57.34.2.G.F.E.D.C.15.A2.-1 

2840 

REM 

2850 

2860 

REM  'IF  THE  CROSSHAIR  IS  NOT  IN  THE  RIGHT  LOCATION. 
REM  IT.  IN  EITHER  CASE  IT  MILL  WRITE  THE  ORIGINAL 

YOU  CAN  MOVE 
PICTURE  BACK  IN 

2870 

REM  TO  THE  QUANTEX  BEFORE  EITHER  GOING  BACK  TO  THE 

BEGINNING  OR 

■PT’T'Tl 

■ 

2890 

2900 

REM 

PRINT  *IS  THIS  THE  POINT  YOU  WANT?* 

2910 

INPUT  A* 

2980 

FOR  1=1  TO  3 

2990 

N=N1 

3000 

3010 

GOSUB  5020 

K2=63+21*< 1-1 ) 

3020 

FOR  J=1  TO  21 

04 

o 

o 

NEXT  J 

W  Mil 

1  'IV*  i  Vf  R4*'F!  jR  41 

3060 

3070 

N1=N1+512 

NEXT  I 

3080 

N1=(Y-10)*512+<X-1) 

FOR  1=1  TO  21 

3100 

N=N1 

RKCIM 

3120 

3130 

K2=3*  < 1-1 ) 

MBYTE  0361-1 ,0.1 .57,34. 2»G.F,E»D,Cr 15. B(K2+1) ,B(K2+2> ,B<K2+3> »-l 

3140 

N1=N1+512 

3160 

IF  A*=*Y*  THEN  3180 

3170 

3180 

3190 

REM 

REM  *  128  LINES  OF  128  PIXELS  EACH  ARE  READ  OUT  FROM 

THE  QUANTEX. 

3200 

3210 

REM  A  SQUARE  OF  FOUR  PIXELS  AREADDED  TOGETHER  AND  DIVIDED  BY  FOUR 
REM  TO  FORM  A  NEW  DATA  POINT.  THIS  REDUCES  THE  ARRAY  TO  64X64 

3220 

REM  PIXELS.  THESE  PIXELS  ARE  PACKED  FOUR  TO  ONE  EIGHT  DIGIT 

■OTTl 

i  fin  1 1 1  f— ■ 

3240 

3241 

REM 

PRINT  'A  128X128  PIXEL  IMAGE  WILL  NOW  BE  READ  OUT. 

YOU  CAN* 

3242 

PRINT  'HAVE  THIS  IMAGE  REDUCED  TO  64X64  PIXELS  BY  TYPING  R.  * 

■4ZH 

PRINT  “IF  YOU  WANT  THE  FULL  IMAGE  TYPE  F.* 

3244 

INPUT  F* 

PWH 

3250 

3260 

H=0 

Nl  =  <  Y-64 )*512+ (X-64 ) 

3270 

FOR  1=1  TO  64 

3280 

N=N1 

3290  GOSUB  5020 

3300  MBYTE  936 S-l ,0, 1 .61 , 34 > 2.G.F, E.D, C .3.36.56* 64 ,80,96, 15 


C-3 


1 


• 

3310 

3320 

MBYTE  0681 

RBYTE  AO 

3330 

N-N14512 

3340  GOSUB  5020 _ _ _ 

3350 

MBYTE  0361-1.0.1 .61 .34.2.G.F.E.D.C.3. 36.56.64 .80.96. 15 

3340 

MBYTE  0681 

3370 

RBYTE  A1 

3380 

K2=<I-1>*16 

3390 

FOR  J=1  TO  16 

3400 

K3=<J-1>*8 

3410 

X1«INT<  < A0<K341 )4A0<K342)4A1 (K341 )4A1(K342>  >/16> 

3420 

X2= 1 NT  < ( AO ( K3+3  > +A0  < K344 ) 4 A 1 <  K343  > 4A1 <  K344  >  > / 1 6  > 

3430 

X3-INT<  <A0(K3+5)+A0(K3+6)+Al (K3+5)+Al<Ki46) )/16> 

« 

3440 

X4=INT ( < A0(K3+7)+A0<K3+8)+Al (K347)4A1 (K348  > )/16) 

•» 

3430 

B(K24J)»X1*10000004X2*1 00004X3* 1004X4 

M 

3460 

H<X141)=HCX141>41 

3470 

H<  X241 )*H(X241 >41 

3480 

H(X341)»H(X341)41 

•* 

3490 

H<X441  )=H<X441  >41 

" 

3500 

NEXT  J 

•t 

3510 

IF  I<3  OR  I>62  THEN  3580 

3520 

AO  < 1 ) ”252 

3530 

AO <2 >-252 

3540 

A0< 127) =252 

3550 

A0< 128 )=252 

3560 

A0< 129)=-1 

3570 

GO  TO  3600 

3580 

A0=252 

" 

3590 

A0< 129)=-1 

3600 

MBYTE  0361-1 .0.1.57.34.2.G.F.E.D.C.15.A0 

3610 

N1=N141024 

3620 

NEXT  I 

3621 

PRINT  “WHAT  TAPE  FILE  DO  YOU  MANT  TO  STORE  THE  IHAGE  IN? 

iT* 

3622  PRINT  'MUST  BE  AT  LEAST  44000  BYTES  LONG.* 

3623 

INPUT  AS 

3624 

PRINT  'INSERT  THE  TAPE  AND  HIT  RETURN.- 

3625 

INPUT  Ft 

3630 

FIND  A5 

3640 

WRITE  1 024 .16. 64 .  H » B 

3650 

END 

4000 

REM  -128  BY  128  PIXELS  ARE  READ  OUT  AND  STORED  IN  A  FILE 

ON 

4010 

REM  TAPE.- 

4020 

PRINT  -WHAT  TAPE  FILE  DO  YOU  WANT  TO  STORE  THE  IMAGE  INT 

IT* 

4021 

PRINT  -MUST  BE  AT  LEAST  88000  BYTES  LONG.- 

« 

4022 

INPUT  A5 

4023 

PRINT  -INSERT  THE  TAPE  AND  HIT  RETURN. 

4024 

INPUT  F* 

4025 

DELETE  At >  AO. A1 . A2. D 

4030 

DIM  A0< 129). All  129) » A2< 129 > ,M< 32 > . At < 365 > »Bt < 365) 

4031 

A=1 

4032 

CALL  -UNIT*. A 

4033 

CALL  -MOUNT -.A .At 

4035 

OPEN  -0IMAGE/ONE*  »-G-ll»*F-iBt 

4036  PRINT  Bt _ 

« 

4037 

CALL  -REMIND*. 1 

4040 

A0=0 

4050 

A1*0 

4060 

A2-0 

« 

4260 

Nl»< V-64  )*5l24<*-44> 

U 

4270 

FOR  1=1  TO  128 

4285 

N-Nl 

4290 

GOSUB  5020 

4300 

MBYTE  036 i -1.0. 1.61 .34 p2pGvF.EpDpCp3p 36.56.64.80.96. 15 

4310 

MBYTE  068! 

4320 

RBYTE  A2 

4330 

> 

o 

a 

> 
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100  INIT 

110  PAGE _ 

120  DIM  H ( 64  > » B*  <  64 ) » C*  <  64 ) 
130  PRINT  051 8 ‘L* _ 


160  PRINT  'INSERT  THE  TAPE  THAT  CONTAINES  THE  IMAGE  AND  PRE 
170  PRINT  ‘RETURN* _ 

180  INPUT  A6 

181  PRINT  ‘UHAT  DO  YOU  WANT  TO  TITLE  THE  PICTURE?* _ 

182  INPUT  D* 

190  FIND  A5 _ 

200  READ  033!X»X8.T8>H 

210  T3=X8*Y8 _ 

220  DIM  B(T3) 

230  READ  033 JB 

~]g3RrREH~TrTHP5  THE  HTH  AND  Hffg~PT7rL~l7WL0E5'«  * - 

250  1=1 _ 

260  IF  H< I )>0  THEN  300 

270  1*1  +  1 _ _ 

280  IF  I >64  THEN  370 

290  GO  T0_260 _  _ 

300  M1=I-1 


320  IF  H< I )>0  THEN  350 

330  1=1-1 _ 

340  GO  TO  320 

.350  M2-I-1 _ _ 

360~PRINT  051 SMi »M2*D4* ‘J* 

370  Y*9.99/<M2-H1> _ 

380  FOR  J=1  TO  16 

390  FOR  L=1  TO  4  _ 

400  M*,r 

410_C4=1* _ _ 

420  K2«100"<4-L) 

_43jP_15A4 _ 

440  K=J+<I-1)*16 

450  X»I NTJ B<K)/K2 ) _ 

460  B  < K ) =B < K ) -X*K2 

470  N°INT <_< X-Ml  )«Y) _ 

480  GOSUB  570 


500  IF  1-0  THEN  520 

510  GO  TO  440  ___ _ 

520  PRINT  05~i:B« 

530  PRINT  051SC*.*J* 

~S45"nExTT - 

550  NEXT  J _ 

560  END 

570  GOSUB  N+l  OF  860 > 830 > 800 t 770 t 740 r 710>680»650»620»590 
580  REfURN 

590  B4-B4I*  * _ _ 

600  C*»C*'^•  ■ 

610  RETURN _ 

"620  B*-B*»*.  • 

630  C*?C*«*  ■  _  _ 

640  RETURN-- 

650  Bt-B**':* _ _  _ 

660  C»«d*T'  • 

670  RETURN _ 

680  Bt-Btt'I* 

690  C»-C«l _ 

700  RETURN 

710  B*"B*B,U*  _  _ 


730  RETURN 


r  9 


740 

B«-B«S‘0* 

. 

7S0 

r*«r»» ■  • 

740 

RETURN 

770 

• 

780 

cb»cb**-* 

• 

790 

RETURN 

• 

800 

Bt-B«Sa0* 

• 

BIO 

820 

RETURN 

» 

BMMl'O* 

* 

840 

CMC***** 

• 

«• 

RETURN 

m 

"" 

840 

B*-B**‘0* 

" 

Ctsgfl’ftl 

'•  880  RETURN 
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